Kernel Approximation: From Regression to Interpolation
نویسندگان
چکیده
In this paper we introduce a new interpolation method, known as kernel interpolation (KI), for modeling the output from expensive deterministic computer experiments. We construct it by repeating a generalized version of the classic Nadaraya-Watson kernel regression an infinite number of times. Although this development is numerical, we are able to provide a statistical framework for KI using a nonstationary Gaussian process. This enables us to quantify the uncertainty in the predictions as well as estimate the unknown parameters in the model using empirical Bayes method. Through some theoretical arguments and numerical examples, we show that KI has better prediction performance than the popular kriging method in certain situations.
منابع مشابه
Mercer Kernels and Integrated Variance Experimental Design: Connections Between Gaussian Process Regression and Polynomial Approximation | SIAM/ASA Journal on Uncertainty Quantification | Vol. 4, No. 1 | Society for Industrial and Applied Mathematics
This paper examines experimental design procedures used to develop surrogates of computational models, exploring the interplay between experimental designs and approximation algorithms. We focus on two widely used approximation approaches, Gaussian process (GP) regression and nonintrusive polynomial approximation. First, we introduce algorithms for minimizing a posterior integrated variance (IV...
متن کاملMercer kernels and integrated variance experimental design: connections between Gaussian process regression and polynomial approximation
Abstract. This paper examines experimental design procedures used to develop surrogates of computational models, exploring the interplay between experimental designs and approximation algorithms. We focus on two widely used approximation approaches, Gaussian process (GP) regression and nonintrusive polynomial approximation. First, we introduce algorithms for minimizing a posterior integrated va...
متن کاملSparse Projections of Medical Images onto Manifolds
Manifold learning has been successfully applied to a variety of medical imaging problems. Its use in real-time applications requires fast projection onto the low-dimensional space. To this end, out-of-sample extensions are applied by constructing an interpolation function that maps from the input space to the low-dimensional manifold. Commonly used approaches such as the Nyström extension and k...
متن کاملThe modified degenerate kernel method for the multi-dimensional Fredholm integral equations of the second kind
In this paper, to investigate the multi-dimensional Fredholm integral equations of the second kind a modified degenerate kernel method is used. To construct the mentioned modified, the source function is approximated by the same method which employed to obtain a degenerate approximation of the kernel. The Lagrange interpolation method is used to make the needed approximations. The error and ...
متن کاملArmin Iske * Scattered Data Approximation by Positive Definite Kernel Functions
Kernel functions are suitable tools for scattered data interpolation and approximation. We first review basic features of kernel-based multivariate interpolation, before we turn to the construction and the characterization of positive definite kernels and their associated reproducing kernel Hilbert spaces. The optimality of the resulting kernel-based interpolation scheme is shown. Moreover, we ...
متن کامل